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1 Introduction 



In this work we consider stability properties of a class of jump-diffusion processes that are 
constrained to lie in a convex closed polyhedral cone. Let G be a cone in iR", given as the 
intersection CiiGi of the half spaces 

G^ = {x £ M"- : x-n,>0}, i = l,...,N, 

where rii, i = 1, . . . , N are given unit vectors. It is assumed that the origin is a proper vertex 
of G, in the sense that there exists a closed half space Go with G CiGq = {0}. Equivalently, 
there exists a unit vector oq such that 

{xeG :x-ao<l} (1.1) 

is compact. Note that, in particular, N > n. Let Fi = dG H dGi. With each face Fi we 
associate a unit vector di (such that • > 0). This vector defines the direction of constraint 
associated with the face Fi. The constraint vector field d{x) is defined for x € dG as the set of 
all unit vectors in the cone generated by G In(x)}, where 

In(x) = {i £ {I, . . . , N} : X ■ Ui = Q}. 

Under further assumptions on (n^) and {di), one can define a Skorohod map T in the space of 
right continuous paths with left limits, in a way which is consistent with the constraint vector 
field d. Namely, F maps a path ip to a path (p = ip+r] taking values in G, so that r] is of bounded 
variation, and, denoting the total variation of r/ on [0, s] by |7?|(s), dr]{-)/d\r]\{-) £ d((/)(-)). The 
precise definition of T and the conditions assumed are given in Section [21 The constrained 
jump-diffusion studied in this paper is the second component Z of the pair {X, Z) of processes 
satisfying 

Xt = zo+ f'p{Zs)ds+ f a{Zs)dWs+ I h{5{Z,^,z))[N{ds,dz) - q{ds,dz)] 

Jo JO J[0,t]xE 

+ / h\6{Zs^,z))N{ds,dz), (1.2) 

J[0,t]xE 

z = r{x). (1.3) 

Here, W and N are the driving m-dimensional Brownian motion and Poisson random measure 
on iR_(_ X E; P, a and 6 are (state-dependent) coefficients and /i is a truncation function (see 
Section [21 for definitions and assumptions). For illustration, consider as a special case of H1.2(l . 
H1.3|l , the case where X is a Levy process with piecewise constant paths and finitely many jumps 
over finite time intervals. Then Xt = x ^^^^ AXg, where AXg = Xg — Xg-. In this case, 
Z is given as Zt = x + X]s<t AZg, where AZ^ can be defined recursively in a straightforward 
way. Namely, if Zg- + AXg G G, then AZg = AXg- Otherwise, Zg = Zg^ -|- lS.Xg -|- ad, 
where a G (0, oo), Zg G dG, and d G d{Zs). In general, this set of conditions may not have a 
solution {a,d), or may have multiple solutions. However, the assumptions we put on the map 
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r will ensure that this recursion is uniquely solvable, and as a result, that the process Z is well 
defined. 



A related model for which recurrence and transience properties have been studied exten- 
sively is that of a semimartingale reflecting Brownian motion (SRBM) in polyhedral cones 
[HlEl^Q^l^]- Roughly speaking, a SRBM is a constrained version, using a "constraining 
mechanism" as described above, of a Brownian motion with a drift. In a recent work 
sufficient conditions for positive recurrence of a constrained diffusion process with a state de- 
pendent drift and (uniformly nondegenerate) diffusion coefficients were obtained. Under the 
assumption of regularity of the map F (as in Condition l2.4l below) . it was shown that if the drift 
vector field takes values in the cone C generated by the vectors — dj, i = 1, . . . , A^, and stays 
away, uniformly, from the boundary of the cone, then the corresponding constrained diffusion 
process is positive recurrent and admits a unique invariant measure. The technique used there 
critically relies on certain estimates on the exponential moments of the constrained process. 
The current work aims at showing that C plays the role of a stability cone in a much more 
general setting of constrained jump-diffusions for which only the first moment is assumed to be 
finite. The natural definition of the drift vector field in the case of a jump-diffusion is /5 = £ id, 
where L denotes the generator of a related "unconstrained" jump-diffusion (see (|2.6() ). and 
id denotes the identity mapping on MP" . In the case of a Levy process with finite mean, the 
drift is simply (5{x) = E^Xi — x (which is independent of x). Our basic stability assumption 
is that the range of /3 is contained in U^g^v^Ci, where Ci is a compact subset of the interior 
of C. Under this assumption, our main stability result states (Theorem I2.1(-i|) : There exists a 
compact set A such that for any compact C C G, 



where ta is the first time Z hits A, and Ex denotes the expectation under which Z starts from 
X. The proof of this result is based on the construction of a Lyapunov function, and on a careful 
separate analysis of small and large jumps of the Markov process. As another consequence 
of the existence of a Lyapunov function we show that Z is bounded in probability. From the 
Feller property of the process it then follows that it admits at least one invariant measure. 
Finally, under further suitable communicability conditions (see Conditions 12.181 and I2.2U() it 
follows that the Markov process is positive Harris recurrent and admits a unique invariant 
measure. 

The study of these processes is motivated by problems in stochastic network theory (see 
|18j for a review). The assumptions we make on the Skorohod map are known to be satisfied 
by a large class of applications, including single class open queueing networks (see [HI, COl)- 

For a sampling of stability results on constrained processes with jumps we list jHIKl lT^ ITT H 
ll9H2Uj . We take an approach similar to that of [S], where the stability properties of SRBM in 
an orthant are proved by means of constructing a Lyapunov function. At the cost of putting 
conditions that guarantee strong existence and uniqueness of solutions to the SDE, we are 
able to treat diffusions with jumps and state-dependent coefficients. One of the key properties 



sup ExTA < oo 
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of the Lyapunov function / constructed in |S], is that Df{x) ■ b < —c < for x £ G \ {0}, 
where b denotes the constant drift vector of the unconstrained driving Brownian motion. In 
a state-dependent setting, an analogous condition must hold simultaneously for all b in the 
range of /3. The construction of the Lyapunov function is therefore much more involved. The 
basic stability assumption referred to above plays a key role in this construction. 

The paper is organized as follows. In Section 2 we present basic definitions, assumptions, 
statements of main results and their corollaries. Section 3 is devoted to the proof of (|1.4j) . 
under the assumption that a suitable Lyapunov function exists. We also show in this section 
that the Markov process is bounded in probability. In Section 4 we present the construction 
of the Lyapunov function. Since many arguments are similar to those in [Hj, we have tried to 
avoid repetition wherever possible. Finally, we have included certain standard arguments in 
the appendix for the sake of completeness. 

The following notation is used in this paper. The boundary relative to iR" of a set A C iR" 
is denoted by dA. The convex hull of A is denoted by conv(^). The cone {X^ig/Q^i^i • 
cti > 0,i £ 1} generated by {vi,i G /), is denoted by cone{fj,i G I}. The open ball of 
radius r about x is denoted by B{x,r), and the unit sphere in by S""^^. D{[0,oo) : iR") 
denotes the space of functions mapping [0, oo) to iR" that are right continuous and have 
limits from the left. We endow Z)([0, oo) : iR") with the usual Skorohod topology. We define 
L>a([0,oo) : iR") = {ip e £»([0,oo) : iR") : V'(O) G A}. For r/ G D{[0,oo) : ST), \j]\{T) denotes 
the total variation of r/ on [0, T] with respect to the Euclidean norm on iR". The Borel cr-field 
on iR" is denoted by S(iR") and the space of probability measures on (iR", B{1R^)) by V^M""). 
Finally, a denotes a positive constant, whose value is unimportant and may change from line 
to line. 

2 Setting and results 

Recall from Section ^ the assumptions on the set G and the definition of the vector field d, 

d{x) = cone{dj,i G In(x)} n 5""^ 

For X G 9G, define the set n[x) of inward normals to G at x by 

n{x) = {v : \v\ = 1, 1^ ■ (x — y) < 0, V y G G}. 

Let A be the collection of all the subsets of {1,2,..., N}. We will make the following basic 
assumption regarding the vectors {di,ni). 

Condition 2.1 For each A G A, A 7^ 0, there exists a vector d^ G cone{di,i G A} with 

-UiyO for all i G A. (2.1) 
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Remark 2.2 An important consequence (cf. |S]) of the above assumption is that for each 
A G A, A 7^ there exists a vector n'^ such that re"^ S n{x) for ah x E G satisfying In(x) = A 
and 



Definition 2.3 Let ip e Dg{[0, oo) : iR") be given. Then (0, t]) G -D([0, oo) : iR") x L'([0, cx)) : 
iR") solves the Skorohod problem (SP) for -0 wii/i respect to G and d if and only if = 
and for all t G [0, oo) (1) (pit) = ^{t) + i]{t); (2) cl){t) G G; (3) \r]\{t) < oo; (4) 



On the domain D C Dg([0, oo) : IRJ^) on which there is a unique solution to the SP we define 
the Skorohod map (SM) F as T{iIj) = 0, if V' — 4>) is the unique solution of the SP posed 
by ij:. We will make the following assumption on the regularity of the SM defined by the data 



{{di,ni);i = l,2,...,N]. 

Condition 2.4 The SM is well defined on all of Dg{[0,oo) : iR"), i.e., D = Dg{[0, oo) : iR") 
and the SM is Lipschitz continuous in the following sense. There exists a constant i < oo such 
that for all c^i, (/>2 G Dg{[0, oo) : iR"); 



We will assume without loss of generality that i > 1. We refer the reader to El ^] for 
sufficient conditions for this regularity property to hold. 

We now introduce the constrained processes that will be studied in this paper. 

Definition 2.5 Let (Xt) be a Levy process starting from zero (i.e. Xq = 0) , with the Levy 
measure K on (iR", i3(iR")). Define a "constrained Levy process", starting from zq G G, by 
the relation 



n ■ di> for ah i G A. 



(2.2) 




sup \r{^i){t)-r{^2m\<£ sup \Mt)-Mt)\- 



(2.3) 




z = r{zo + x). 



Recall that a Levy measure K is a measure that satisfies the condition |yp A \K{dy) < oo 
(see [2], Chapter 1). We will make one additional assumption on K, as follows. 



Condition 2.6 The Levy measure K satisfies 
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The above assumption holds if and only if the Levy process Xt has finite mean. 

We now define the reflected jump-diffusions considered in this work. On a complete filtered 
probability space (fi, JF, (JT^), P), let an m-dimensional standard Brownian motion W and a 
Poisson random measure N on iR_|_ x with intensity measure q{dt, dz) = dt ® F{dz) be 
given. Here, {E,£) is a Blackwell space and F is a positive u-finite measure on {E,£). For all 
practical purposes, {E,£) can be taken to be {JR"" ,B{]R^)) (see d]). Let a truncation function 
h : iR" iR" be a continuous bounded function satisfying h{x) = x is a neighborhood of 
the origin and with compact support. We fix such a function throughout, and denote also 
h'{x) = X — h{x). The reflected jump-diffusion process (Zt) is given as the strong solution to 
the set of equations (|1.2|) . The following conditions will be assumed on the coefficients 

and the intensity measure. 

Condition 2.7 There exists 6 € (0, cxd) and a measurable function p : E ^ [0, oo) such that 

/ p^{z)F{dz) < CXD, 
Je 

and the following conditions hold. 

(i) Lipschitz Condition: For all y,y' £ IR^, z £ E, 

\P{y)-(3{y')\ + \a{y)-a{y')\<e\y-y'l 

\h{5{y,z))-h{5{y',z))\<p{z)\y-y'\, 
\h'{6{y,z)) - h'i5iy' ,z))\ < p\z)\y - y'\. 

(a) Growth Condition: For all y £ M"', z £ E, 

\h{6{y,z))\<p{z), 
\h'i5iy,z))\<pHz)ApHz). 

Under the above conditions it can be shown that there is a unique strong solution to ()1.2() 
and which is a strong Markov process. Le., the following result holds. 

Theorem 2.8 Suppose that Conditions \2.4\ and \2.T\ hold, and that on {i},J-,J^t,P) we are 
given processes {W,N) as above. Then, for all x £ G there exists, on the basis {Q,J-',J-'t,P), a 
unique pair of {J^t}- adapted processes {Zt,kt)t>o with paths in Z)([0, oo) : M^), and a progres- 
sively measurable process {'~ft)t>o, such that the following hold: 
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1. Zt £ G, for all t>Q, a.s. 

2. For all t > 0, 

Zt = x+ t [5{Zs)ds+ f a[Zs)dWs + I h{6{Zs-, z))[N{ds,dz) - q{ds,dz)] 

Jo JO J[0,t]xE 

+ / h'i6iZs-,z))N{ds,dz) + kt, (2.4) 

J[0,t]xE 

a.s. 

3. For all T G [0, oo) 

\k\T < oo, a.s. 

4- 



t 

I{Zs(LdG}'Ak\s, 



and kt = jQjsd\k\s with js G d{Zs) a.e. [d\k\]. 

Furthermore, the pair {Zt — kt,Zt) is the unique {!Ft}-adapted pair of processes with cadlag 
paths which satisfies equations hl.'A for all t, a.s., with the given driving terms {W,N). 
Finally, {Zt) is a strong Markov process on {Vt,J-,J-t,P). 

The proof of the theorem follows via the usual Picard iteration method on using the Lipschitz 
property of the SM. We refer the reader to [S] where a similar argument for constrained diffusion 
processes is presented. 

Remark 2.9 Condition 12.71 is a version of the assumptions in Chapter III, where strong 
existence and uniqueness results for unconstrained jump-diffusion processes are considered. 
The conditions assumed there are substantially weaker, and can be similarly weakened in the 
current context as well, via similar arguments. 

Remark 2.10 Taking a{z) = a, f3{z) = /3, {E,£) = {M',B{M')), 5{y,z) = z, p{z) = 
l'2|l|2|<i + •\/N"l|z|>i and F{dz) = K{dz), we see that a Levy process satisfying Condition 
12.61 is a special case of the process {Zt} in Theorem 12.81 

Here are the main results of this paper. The first result gives sufficient conditions for tran- 
sience and stability of a reflecting Levy process. The transience proof is a simple consequence 
of the law of large numbers, while the stability is treated in a more general framework in the 
context of a reflected jump-diffusion process. For a Borel set A <Z G, let ta denote the first 
time Z hits A. Define 

C = cone{-(ii,i e {1,...,A^}}. (2.5) 
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Theorem 2.11 Let X and Z he as in Definition \2.5l Assume that Conditions \2.1l \2.4\ and 
lO hold. 



1. If EXi € C^, then there is a constant 7 S G \ {0} such that for all x £ G, Zt/t 'j as 
t 00, Px-a.s. 

2. If EXi G C , then there is a compact set A such that for all M £ (0, cxd), 



Next we consider reflected jump-diffusion processes. If in equation H1.2|) X were replaced by Z, 
and the coefficients a, (3 and 5 were extended to all of iR", then this equation alone would define 
a diffusion process with jumps Z, the extended generator of which we denote by C (see [Tl] . 
Chapter IX, p. 514 for the form of the extended generator in this setting). Let id : IBP IRP 
denote the identity map, and define 



We use the generator of the "unconstrained" jump-diffusion process only as a motivation to 
define the vector field (3. Since we only deal with constrained diffusions, we will consider only 
the restriction of (3 to G, which, with an abuse of notation, we still denote by (3. Of course, 
f3 can otherwise be defined by the right hand side of (|2.6j) . Our main assumption on (3 is the 
following. 

Condition 2.12 There exists a compact setCi contained in the interior C° of C such that the 
range of (3 is contained in Uk^pj kCi. 

Here is the main result on the stability of reflected jump-diffusions. 

Theorem 2.13 Let [Zt) he as in Theorem Wl\ Suppose that Conditions Wli \^ and \TTE 
hold. Then there is a compact set A such that for any compact K C G, sup^g^ Ez^A < 00. 

Remark 2.14 We will, in fact, obtain a more precise bound, namely E^ta < + 1, for 
some constant a independent of z £ G. 

As an immediate corollary of the above theorem we have the following result. 



sup EzTA < 00. 
z£G,\z\<M 




(2.6) 



Note that in view of Condition \2.7\ there is a constant a < 00 such that 




(2.7) 
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Corollary 2.15 Let p{t,x,dy) denote the transition probability function of the Markov process 
{Zf}. Suppose that there is a closed set S C G such that p{t,x,S) = 1 for all x £ S and 
t G (0,00). Let the compact set A be as in Theorem \2.1iA and suppose that the assumptions of 
that theorem hold. Then svly>2^s,\z\<m ^zi'^'Ans) < 00 for all M G (0, 00). 

The following result on "boundedness in probability" of the process {Zf} is a consequence of 
the existence of a suitable Lyapunov function and will be proved in Section 3. 

Theorem 2.16 Let the assumptions of Theorem \2.1^A hold. Then for every M G (0,oo), the 
family of probability measures, {Pz{Z{t) G ■); t G [0, 00), z G G Ci B(0, M)} is tight. 

From the above result we have, on using the Feller property of {Zt}, the following corollary. 

Corollary 2.17 Suppose the assumptions of Theorem hold. Then the Markov process 
{Zt} admits at least one invariant measure. 

We now impose the following communicability condition on the Markov process {Zt} relative 
to a set S. 

Condition 2.18 Let S be as in Corollary \2.15\ and let v be a a-finite measure with support 
S. Then for all r G (0, 00) and G G B{IR'') with v{G) > 0, mi^^s,\x\<r Px{Zi G G) > 0. 

The above assumption is satisfied with S = G and v as the Lebesgue measure, if the diffusion 
coefficient a in (|2.4|1 is uniformly non degenerate. 

Now we can give the following result on positive Harris recurrence. The proof of the theorem 
is similar to that of Theorem 2.2 of ^ and thus is omitted. 

Theorem 2.19 Let the assumptions of Theorem A2.1^ and Corollaru \2.1fA hold. Further sup- 
pose that Condition \2.18\ holds. Then for all closed sets G with ^{G) > 0, and all M > 0, we 
have that sup zizs^\z\<M ^z{tc) < oo. 

Finally, we introduce one more condition which again is satisfied if the diffusion coefficient is 
uniformly non degenerate and v is the Lebesgue measure on G. 

Condition 2.20 For some A G (0, cxd), the probability measure 6 on G defined as 

9{F) = X e-^^p{t,x,F)dt, FgB{G) 
Jo 

is absolutely continuous with respect to v. 
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The following theorem is a direct consequence of Theorem 4.2.23, Chapter 1 of |21j . 

Theorem 2.21 Let the assumptions in Theorem \2.1fA hold. Further suppose that Condition 
\2.2fA holds. Then (Zt) has a unique invariant probability measure. 

3 Proofs of the main results 

We begin with the proof of Theorem 12.111 

Proof of Theorem 12. in Since part 2 is a special case of Theorem 12.131 f note that Condition 
12.71 implies, in the special case of a Levy process, Condition 12. 6|) . we consider only part 1. Let 
P = EXi and let = Then by [3 Lemma 3.1 and Theorem 3.10(2)], T{4>){t) = -ft, 
where 7 / 0. By the Lipschitz continuity of T, Zt = T{(j)){t) + Aj = 7* + Xt, where 

\Xt\ < isup \zo + Xs - s(3\. 

s<t 

From the strong law of large numbers t~^{Xt — tp) a.s. Combined with a.s. local bound- 
edness of X, this implies that sup5<i \zo + Xg — a.s. Thus i~"'^|A£| — > a.s., and this 

proves the result. ■ 

In the rest of the paper we prove Theorem 12 . 1 31 and its consequences. Hence we will assume 
throughout that Conditions lO 1131 EUl and im hold. The proof of Theorem ^THl is based 
on the existence of a suitable Lyapunov function which is defined as follows. 

Definition 3.1 1. We say that a function f C^{G\ {0}) is a Lyapunov function for the 
SP (G, d) with respect to the mean velocity ro, if the following conditions hold. 

(a) For all N £ (0, 00), there exists M £ (0, 00) such that {x £ G, \x\ > M) implies 
that f{x) > N. 

(b) For all e > there exists M £ (0,oo) such that (x £ G, \x\ > M) implies 
\\D^f{x)\\<e. 

(c) There exists c £ (0, 00) such that Df{x) - ro < —c, x £ G\{0}, and Df{x) -d < —c, 
d£d{x), x£dG\{id]. 

(d) There exists L £ (0, 00) such that sup^g^; \Df{x)\ < L. 

2. We say that a function f £ C'^{G \ {0}) is a Lyapunov function for the SP {G,d) with 
respect to the set (of mean velocities) R C M^, if it is a Lyapunov function for the SP 
{G,d) with respect to the mean velocity rg, for any tq £ R, and if in item (c) above, the 
constant c does not depend on rg £ R. 
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Remark 3.2 (a) If / is a Lyapunov function for the SP (G, r) with respect to a certain set R, 
then Df is Lipschitz continuous on {x € G : \x\ > M} with parameter e, where e > can be 
taken arbitrarily small by letting M be large. This implies a useful consequence of the second 
part of item (c) in Definition 13.11 as follows: There exist Mq G (0, do), Sq G (0,1) such that 
Df{x) • d < — c/2, whenever d £ d{y), |y — x| < 5o, y G dG, \x\ > Mq. 

(b) If / is a Lyapunov function for (G, d) with respect to a set R, then it is automatically a 
Lyapunov function for {G,d) with respect to Ufcgjv^-R- 

We say that a function / is radially linear on G if f{sx) = sf{x) for all s £ (0, oo) and x £ G. 
The following result is key to the proof of Theorem 12. 131 and will be proved in Section 4. 

Theorem 3.3 Let the assumptions of Theorem \2. 1 'A hold. Then there exists a Lyapunov func- 
tion f for the SP {G,d) with respect to the set Ci, where Ci is as in Condition \2. ISl Further- 
more, f is radially linear on G. 

We now turn to the proof of Theorem 12.131 Write (|2.4|) as 

rt rt 

Zt = zo+ i3{Zs)ds + / a{Zs)dWs + ^ + Mf ^ + h, 
Jo Jo 

where 

^ = / h{6{Zs-,z))[N{ds,dz) - q{ds,dz)], 
J[0,t]xE 

Mf ^ = / h'{6{Zs-,z))[N{ds,dz) - q{ds,dz)] 

J[0,t]xE 

and is as in ()2.6() . Note that the term that has been subtracted and added is finite (e.g., 
by (fT7|) ). Let also 

Ut= [ P{Zs)ds, 
Jo 

and 

Mt = / a{Zs)dWs + M^^^ + Mf \ 
Jo 

Then 

Zt = zo + Ut + Mt + kt. (3.1) 
Let / be as in Theorem 13.31 From Condition 12.121 it follows (see also Remark I3.2r b)^ that 

Dfix)-Ut<-c, x£G\{0}, t>0, (3.2) 

where c is as in Definition 13.11 For any k G (0, oo) and compact set A C iR", define the 
sequences (a„), (an) of stopping times as fio = 0, 

5-n = ^n{i^) = inf{t > an-i : \Xt - > k}, 
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Let also 

h{t) = inf{n : (j„ > t}, 

n(t) = n{t, A) = inf{n : o"„ > A t}, 

where the infimum over an empty set is oo. Note that n{t A ta) = n{t), a.s. The following are 
the main lemmas used in the proof of Theorem 12.131 

Lemma 3.4 {M^^'^} and {Jq a{Zs)dWs} are square integrable martingales and {M^'^^} is a 
martingale. 

Lemma 3.5 There exists a constant c\ = ci(k) G (1,oo) such that for any hounded stopping 
time T, En^r) < ci{Et + 1). 

For s S [0, cxd), and a cadlag process {Yt}, we write Yg — Yg- as AYg. 

Lemma 3.6 There is a bo € (0, oo) and a function a : [0, oo) i-^ [0, oo) with a(b) as 
b ^ oo such that for any bounded stopping time t, and b > bo, 

Ej2\AXs\l\^x.\^,<a{b)ET. 

s<r 

Proof of Theorem I2.13t Let / be as in Theorem 13.31 and let oq be as in Hl.l() . For any M, 

the level set {x £ G : f{x) < M} is compact. If M = M{M) = max{|x| : f{x) < M}, then 
the set 

A = A{M) = {xeG:x-ao<M} (3.3) 

contains the level set, and is compact. In addition, G \ A is convex. Definition 13. 11 1(a). (b) 
implies that there is a function eo{M) such that ||D^/(a;)|| < eo(M) for x G G \ A{M), and 
where M = M{M) is as above, and eo(M) ^ as M ^ oo. The notation eo(M) and M(M) 
is used in what follows. 

Write Xn = -'^o-n, = Xo-„_, where {Xt} is as in H1.3() . Define similarly z„, 
Un, Un-, rUn, rUn- for the processes k,Z,U and M, respectively. Let k be so small that 
2iK < do/2, where Sq is as in Eemark I3.2r a). k will be fixed throughout. The proof will be 
based on establishing a bound on Ef{zm) = f{zo) + J2T ^ifi^n) — f{zn-i)]- According to 
(|3.1|) . one has 

Zn Zn—l — Xfi Xfi—l ~l~ /Cri ^n— 1 

We consider two cases. 
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Case 1: |x„ — Xn-i\ < 2k. 

Consider the linear interpolation defined for 9 G [0, 1] as 

/ = Zn-l + 0{Zn - Zn-l). 

Then ^ 

f{Zn) - f{Zn-l) = f Df{z')de ■ {Zn " Zn-l). (3.4) 

Jo 

By the Lipschitz continuity of the SM, G B21k{z^) C Bs^^|2{z^) for 6* G [0, 1]. Also note that 
for s £ [(T„„i,cr„], 

7« G U d{x) C U [d\k\] a.s. (3.5) 

Let M be so large that M > Mq + I, where Mq is as in R,emark l3.2r a). Then any x € A = A{M) 
satisfies |x| > Mq + 1. By convexity of A we therefore have for n < n{oo) that \z^\ > M > 
Mq + I, and we get from (jSISI) that for 6 e [0, 1], 

Df{z^) ■ [K - K-i] = Df{z') / -isd\k\s 

J <yn-\ 

< -lmn-\k\n-l)<0. (3.6) 

Now let e = eo(M — ib). By ()3.2|) . Df{z^) ■ {un — Un-i) < —c{an — Cn-i)- Therefore, from part 
(b) of Definition nm and (E21), (EHl), we have 

f{Zn)- f{Zn-l) < Df{Zn^i){Zn-Zn-l)+ C\Df{z%-Df{z'')\de\Zn-Zn-l\ 

Jo 

< Df{Zn-l){Zn - Zn-l) + (e) (2^k) (2£^j) 

< -c{an - CFn-l) + Df{zn-i){mn- mn-i) + ^{(-feK^. (3.7) 

Case 2.' \xn Xn — 1| ^ 2av. 

The argument applied in Case 1 gives an analogue of (|3.7j) in the form 

fiZn^) - f{Zn-l) < -c{an - CFn-l) + Df{Zn-l){mn- - m„_i) + UcK^ . (3.8) 

Next we provide a bound on f{zn) — f{zn-)- Let 

z'^ = Zn-+e{Zn-Zn-), ^G[0,1]. 

Note that kn — kn- G d{zn), by Definition 12.31 and therefore Df{zn) • {kn — kn-) < 0. Also, 
recall that \Df \ < L. Let bo be as in Lemma [3. 61 and 6 > 6o be arbitrary. Then if |x„ — < b, 
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then for all 6 € [0, 1], - < £b, and therefore the bound \\D'^f{z^)\\ < e = eo(M(M) - lb) 
holds. Thus 

f{Zn)-f{Zn-) = (^1^ Df{z')dey[{Xn-Xn-) + {kn-kn-)] 

= Dfizn-) ■ (x„ - Xn-) + f\Df{z') - Df{zn^))de ■ (x„ - 

Jo 

+Df{Zn) ■ {K - K-) + I {Df{z') - Df{Zn))de ■ {kn " k^-) 

Jo 

< Df{Zn~-) ■ {Xn - Xn-) + 2efb'^ + 4£L\Xn - Xn~\l\x„-x„-\>b 

= Df{Zn-)-{mn-mn-)+2eeb'^ +UL\Xn-Xn-\Mxu-Xr.-\>h- (3.9) 

Let Jq{t) denote the set {n < n{t) Aq : |x„ — x„_i| > 2k,}. Combining (|3.7|) . (|3.8j) and (|3.9j) 
we get 

f{zn)-f{zn-i) < -can{t)Aq+ ^/(^n-i) - + 4£eK%(t) A g 

n<n{t)Aq n<n{t)Aq 

+ Y (DfiZn^) - Df{Zn-l)) ■ {mn - mn-) 
neJq{t) 

+ Y {2efb^ +ML\Xn-Xn-\ll,„-.„_l>b)■ 
neJg(t) 

Since m„ — m„_ = x„ — , the following inequality holds 

Y (Dfizn-) - Dfizn-i)) ■ (m„, - < ^ {2efb^ + AiL\xn - x„_|l|,„_,„_|>fe). 

J,(i) Jg{t) 

Writing Mt = En<n(t)A9 -^/(^n-i)("i„ ~ ^n-i), we get 

f{Zn(t)Aq) - fizo) = Y (/(^") ~ f i^n-l)) 

n<n{t)Aq 

+ 2eeH^\Jqit)\ + Y ^tL\Xn-XnAM-r.~x„-\>b- (3-10) 

From Lemma 13.41 E{Mt) = 0. Using Lemma 13.51 

E{n{t)) = E{n{t A ta) < ci{E{t A ta) + 1). 

Observing that 

Y - Xn-\l\x„-x„-\>b < Y \^^s\i\AXs\>b, 

n£jq{t) s<tATA 
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we have from Lemma 13.61 that the expectation of the term on the left side above is bounded 
by a{b)E{TA A t). Combining these observations, we have that 

Ef{znit)Aq) - fizo) < -ci?(cT^(t)Aq) + e{4£K^ + 2eH^) {c, {E {ta a t) + 1) 
+ ULa(h)E{TAM). 

Let h be so large that 4:iLa{b) < c/3. Recalling the definition of e, let M be so large, thus e so 
small, that e{4eK^ + 2fb^)ci < c/3. Then 

-f{zo) - c/3 < -cS(a^(t)A,) + jEiTA A t), 

Taking g —> oo, and recalling that (T:fj(i) > ta /\t, we see that E{ta At) <3/(zo)/c + l. Finally, 
taking t ^ oo, we get for each zq, E^^ta < 3/(zo)/c+ 1. Note that k,ci,c,L do not depend 
on zq, nor do the choices of M,e{M),b,a{b). The result follows. ■ 

We now present the proof of Theorem 12.161 
Proof of Theorem 12.161 The proof is adapted from [T7|, pages 146-147. Since the Lyapunov 
function / satisfies f{z) — > oo as \z\ oo, it suffices to show that: For all > and Lq £ (0, oo) 
there exists an rj such that 

inf PMiZit))<r^)>l-6. (3.11) 

x&G,\x\<Lo 

Let A he as in the proof of Theorem 12.131 Fix A > M and define Ax = {x £ G : x ■ ao > X}. 
Let A = sup{|x| : x S Aj^} and set p = sup{/(x) : x £ G H 5(0,1)}. Recalling the radial 
property of the Lyapunov function we have that for all x ^ 0; f{x) < p\x\. 

Now we define a sequence of stopping times {r„} as follows. Set tq = 0. Define 

r2„+i = mf{t > T2n : Z{t) £ A]; n £ INq 

and 

T2n+2 = inf{t > T2n+i : Z{t) £ Ax}] n £ IVq. 

Without loss of generality, we assume that r„ < oo with probability 1 for all n. From Remark 
12.141 we have that, for all n £ INq, 

E{T2n+l - T2n \ ^t2„) < c|Z^2,J + 1 

< C(|AZ,,J+A) + 1 

< a\AZr^J+a. (3.12) 

Next observe that, for all r] > Xp: 

f{z{t)) <7], t£ [T2n+l,T2n+2),n£ INq. (3.13) 
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Now we claim that there is a constant a such that for all 77 > and x £ G 

P,{ sup f{Z{t)) >r,)< aM±l (3.14) 

0<t<ri r] 

and for all n G IV 

P{ sup > r? I ^.,J < a^^^2^. (3.15) 

T2n<t<T2n+l V 

We only show p.lSf) . since the proof of ()3.14|) is similar. By arguing as in the proof of Theorem 
EUSKsee (Eini)), we have that 

sup f{Z{t))<f{Z^,J+LeK+ sup 5] (/(z,) - /(z,_i)) (3.16) 

T2n<i<T2n+i 1 < A:<n(T2„+i ) l<j<A; 

where {dj} and n(-) are defined as in the displays below (|3.2|) with ctq = T2n (rather than 0) 
and TA replaced by T2n+i- Given a stopping time r, denote the conditional expectation and 
conditional probability with respect to the u-field J^r by JEr and JPr respectively. Then, we 
have via arguments as in Theorem 12.131 that 

^r2„( sup E {fiZj)-fiZj-l))) 

l<k<n{T2„+i) l<j<k 

<^r2„( sup I J2 Df{zj-i){mj -mj_i)\) 

l<k<n{T2n + l) l<j<k 

+a(iE'^2„(r2„+l - T2n) + 1). 

Doob's inequality yields that 

-^T2„( sup I E Df{zj^i){mj - mj-i)\) < a(iE^2n (^2n+i - T2„) + 1). 

I<fe<n(r2„+i) i<j<fc 

Combining the above observations with 1)3. 12() we have that 

^r^J sup J2 ifi^j) - /(^i-i))) < «(|A^.2J + !)• 

l<n<n{T2„+i) l<j<n 

Combining this with 1)3. 16(1 we have ()3.15() . 

Following ^7] we can choose an integer kg and, for each t, an integer valued random variable 
j{t,6) such that Tj(^ ,5) are stopping times and 

P{Tjit,5)<t<rj(t,5)+ks) >l-S/2. 

Now define Jj = [Tj(^t^s)+i-iTTj{t,5)+i) and fix > A/3. Let r' be the hitting time of the set ^4;^ 
by Zt- Then 

PMiZit))>7]) < ^ + X;^x(sup/(Z(s))>r?) 

^ i=l ''^Jr 
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+ sup f{X{s)) > ri) 

0<s<n 



+ 



a{f{x) + l) 



^ S aifix) + l + k5 + bks) 

- 2 7] 

+ ^^^(^^.(..)(E |A^.,,,H.-J1|AZ.^,,,,,_J>.)), (3.17) 

where the third inequality above is the consequence of (|3.13|) . (|3.15j) and (|3.14p and in the 
fourth inequahty b£ (1,cxd) is arbitrary. Next note that 

ks 

^^(^^JM (El^^^.(t,^)+«-i|l|AZ.^.,,_,)+,_J>fe)) 
i=l 

< MJEr,,,,,,{ E |AZ,|1|AZ.|>6)) 

< E^{]Er^^^^^^{f h'{5{Zs-,z))l\h,^s{z._^,))\^,F{dz)ds)) 

< {ks + l)a{h), 
where a{b) = Jj^ p'^{z)lp2^^)yhF{dz). 

Using the above observation in p.l7() we have that 

Px[f[Z[t)) >r])<- + + -{ks + 1)q(6). 

2 T] T] 

The result now follows on taking rj suitably large. ■ 
We now give the proofs of the lemmas. 



Proof of Lemma 13.41 Since o(-) is a bounded function we have that /q a{Zs)dWs is a square 

(2) 

integrable martingale. In order to show that is a martingale, it suffices to show, in view 
of Theorem II.1.8 of 14 that for all T G [0, oo), 

/ E\h'{S{Zs-,z))\q{ds,dz) < oo. 

J[0,T]xE 

(The cited theorem states a local martingale property, however the proof there shows the 
above stronger assertion.) The inequality follows on observing that from Condition 12.71 the 
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above expression is bounded by T Jj^ p^{z)F{dz) < oo. Finally, in view of Theorem II. 1.33 of 
[Tlj . to show that M^^^ is a square integrable martingale, it suffices to show that 



sup f E\h{5{Zs-,z))\^F{dz) <oo. 



se[o,r] 

The last inequality follows, once more from Condition 12.71 



Proof of Lemma 18:51 Recah that Xt = zo + /g l3{Zs)ds + Jq a{Zs)dWs + ^ + Aff \ where 
m/*^ are martingales. Since M^^^ is a square integrable martingale, by Doob's inequality we 
have 

^sup|Mii)|2 < AE\mP\'^ 

s<e 

= AE [ \h{6{Zs-,z))\'^F{dz)ds 

J[0,e]xE 

< 4e / p^{z)F{dz). 

JE 

Also observe that 

E\M^^\ < E\ [ h'{S{Zs-,z))N{ds,dz)\+E\ [ h'{6{Zs-,z))q{ds,dz)\ 

J[0,exE J[0,e]xE 

< 2E [ \h'{6{Zs-,z))\q{ds,dz) 

J[0,e]xE 



< 2e f p^{z)F{dz) 

JE 



where the second inequality is a consequence of Theorem II. 1.8 of Jl] and the last inequality 
follows from Condition 12.71 Using the linear growth of (3 and the Lipschitz property of F, the 
above moment bounds show that 

E sxvi>\Xs — zq\ < a^/e + a f EsVlY>\Xs — ZQ\d9. 
s<€ JO s<e 

Hence, by Gronwall's inequality, for every 5 > there is e > such that i?(supo<s<e l-'^s — -^ol) < 
6. By choosing e G (0, 1) small enough one can obtain 

Pi&i < e) = -P(sup \Xs - Xo\ >k)< 1/2. 

s<e 



Let J-^ = J-a„. By the strong Markov property of Z on J^t, and by considering the 
martingales M^^^__^_^_^ — Af^*j_^ in place of Me^\ one obtains that for any n, P{dn — ^n-i > 
g|_^n-i^ > 1/2. Let T be a bounded (^i)-stopping time. An application of Chebychev's 
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inequality and the observation that since e G (0, 1) the sets {(iTj — aj-i) > e} and {((7j — CTj-i) A 
1 > e} are equal, we have that 

n.(r)AA: 

^E[n{T)Ak]<E J2 E[{a, - di^i) M\r-^]. (3.18) 
^ i=i 

Define 

j 

i=l 

Then {Sj,J-^) is a zero mean martingale. Observing that hr is a stopping time on the filtration 
(.F") we have that for all k G IN, -E'(5'j^(T-)/^fc) = 0. Hence from (|3.18|) it follows that 

n(T)Afc 

^E[n{T) Ak]<E E - ^i-l) ^ 1] < ^(^n(r)-l) + 1 < + 1. 

Taking k ] oo, the result follows. ■ 

Proof of Lemma 13. 6t Let b G (0,oo) be large enough so that h{x) = for |x| > | and 

^^Px€M" — |- Now let -0 ■ ^ [OjOo) be defined as ip{z) = |^;|lfe<|2|<fe', where 

b' £ (6, oo). Clearly, for all x G iR", ^/^(x) = ijj{h'{x)). Now from Theorem IL1.8 of jl4j 

l^^«|l^'<|AX,|<6' = E \h\d{Zs-,z))\lh<\h'{s{z,^,z))\<b'F{dz)ds 

S<T JlO,T]xE 

J E 

< a{b)EiT), 

where q(6) ^ as 6 — > oo. The result now follows upon taking 6' — > oo. ■ 

4 Construction of the Lyapunov function 

This section is devoted to the proof of Theorem 13.31 We begin with a stability result on 
constrained deterministic trajectories which was proved in p]. 

Let Ci be as in Condition [2T2l Let 5 > be such that dist(2;, dC) > 6 for ah x G Ci. Define 

V = {v e B : [ \v{s)\ds < oo,v{t) G Ci, t G (0,oo)}, 
Jo 

where B is the set of measurable maps [0, oo) ]R^. For x G G let 

= {r(x + / v{s)ds) -.v^V}. 
Jo 
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Proposition 4.1 [T] For any x £ G and z G Z^^, the following holds: 



m < 



£\x\ + 6t 



t G [0, oo) 



where £ is the finite constant in \2. 



Using the above result, the following was used in T as a Lyapunov function: 



T{x) = supinf{t G [0,oo) : z{t) = 0}, 



(4.19) 



z 



where the supremum is taken over all trajectories z G Z^^. This function played a key role in 
the proof of positive recurrence of certain constrained diffusion processes studied in ^ . The 
proof in [I] uses crucially certain estimates on the exponential moments of the Markov process. 
Since, in the setting of the current work the Markov process need not even have finite second 
moment, the techniques of do not apply. However, we will show that by using the ideas from 
[S] and by suitable smoothing and modifying the hitting time function T(-), one can obtain 
a Lyapunov function in the sense of Definition 12^2) with R there replaced by Ci. Since for 
z G Za;, z{s) = implies z{t) = for i > s, the function T(-) can be rewritten as 



Our first step in the construction is to replace the above indicator function by a smooth 
function r/ defined as follows. Let tj : M ^ [0, 1] be in C^{1R). Further assume that r]{z) = 
for all z G {—oo, 1], r]{z) = 1 for all z G [2, oo) and "q'iz) > for all z €z M. The next step in 
constructing a Lyapunov function is an appropriate modification of this new T(-) function 
near the boundary and a suitable extension of the function to a neighborhood of G. 

For each A G A, A 7^ 0, fix a vector as in Condition 12.11 Define for f3,x M"' 



where A(x) = {i £ {1, . . . , N} : x ■ Ui < 0}. Now p G G°°{1R"') be such that the support of p is 
contained in {x : \x\ < 1} and p{x)dx = 1. Define for a > 



Now let 5 : iR — > [0, 1] be a smooth function such that g{z) = 1 for z G [0, ^] and g{z) = for 
z G [1, 00). Define for i = 1, . . . , A^, x / and /3 G iR" 



T(x) = sup 




v{l3,x) 



(3 for X G G 
(i^(^) forx^G, 




vt{P,x)=g{ 



dist(x, Fi) 



)di+ l-g{ 



dist(x, Fi) 



) v'^{P,x) 



a\x 



a\x 
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and 



a\x\ 



^ ^^ dist(rc,G) ^ 
a\x\ 



v''if3,x). 



Also set vfiP, 0) = v^iP, 0) = 0, where = (0, . . . , OYiy.^. Let 

K'^ip, x) = conv{<(/3, x);i = 0,l,...,N}. 

Finally, define 

= UpeC^K^iP, x), X G iR". 

Now we can define our second modification to the hitting time function. In this modified 
form the supremum in (|4.19l) is taken, instead, over all solutions to the differential inclusion 
(t){t) £ K"'{(f){t)); = X. More precisely, for a given x G iR" let (/>(•) be an absolutely 

continuous function on [0, cxd) such that 

(^(t) G 0(0) =x; tG[0,oo). 

Denote the class of all such (for a given x) by H"'{x). It will be shown in Lemma 14.41 that 
H°'{x) is nonempty. Our modified form of the Lyapunov function {V^{-)) is defined as follows. 



Vix) = sup / r]{\(l){t)\)dt, x^M' 

SpH'^ix) Jo 



The main step in the proof is the following result. Once this result is proven, parts (a), (b) 
and (c) of Definition 13 . 1 1 used in the statement of Theorem 13.31 follow immediately via one final 
modification, which consists of further smoothing, radial linearization, and restriction to G, in 
exactly the form of |Hj (pages 696-697). Radial linearity of the function thus obtained holds by 
construction. Finally, part (d) of Definition 13.11 follows immediately from radial linearity and 
the fact that the function is on G \ {0}. 

Theorem 4.2 There exist ao G (0, oo) such that the following hold for all a G (0,ao). 

1. There exists r G (0, 1), not depending on a such that V°'{x) = for all x G 5(0, r). 

2. V"'{-) is locally Lipschitz on IR^. In fact, for all R G iR" there exists a{R) G (0, oo) and 
C{R) such that for all x,y £ IR^ with \x\ < R and \x — y\ < C{R), 

\V''{x) -V''{y)\ < a{R)\x - y\, VaG (0,ao). 

3. For a.e. x G iR"; \x\ > 2, 

max DV"-{x) ■ u < -1. 
4- There exists D G (0,oo) such that for all x G iR" with \x\ > 2, V"'{x) > ^^^^ . 
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5. There exists M G (0, oo) such that 

X 

essmfa.gjRn.|^l>M-Dy"(x) • |^ > 0. 

In the remaining part of this section we wih prove the above theorem. The main idea in the 
proof is that the stabiUty properties of the trajectories introduced in Proposition 14.11 imply 
similar properties for the solutions of the differential inclusion (j){t) £ K'^{(j){t)); = x for 
small enough value of a. More precisely, the following result will be shown. 

Proposition 4.3 There exist aQ,T S (0,cxd) such that the following hold. 

1. Whenever g{-) is an absolutely continuous function such that for some a G (0, ao), 

g{t) ^ K'^igit)) a.e. tG [0,oo); |5(0)| < 2"^, 
we have that g{t) = for all t > 2"+^r. 

2. There exist r G (0, 1) such that whenever (f){-) is an absolutely continuous function and 

<j){t) G K'^i^it)), a.e. t; \^{0)\ < r; a G (0, oq), 
we have that supo<f<oo l'^(^)l ^ 1 • 

We now give the proof of Theorem 14.21 assuming that Proposition 14.31 holds. 

A straightforward calculation shows that for a fixed a G (0,oo), and m,M positive finite 
numbers, there exists a constant C{a,m, M) < oo such that 

max sup sup {v^iP, x) - Vi{P,y)\ < C{a,m, M)\x - y\. (4.20) 

i€{0,...,N} fSfzC-^ x,y:m<\x\,\y\<M 

Furthermore , it is easy to see that there exists D G (0, oo) such that 

max sup sup sup \v^{f3,x)\ < D. (4-21) 

jg{0,...,Ar}/3gCi xGiR" ae{0,oo) 

Proof of Theorem 14.21 Let oq and r be as in Proposition 14.31 The choice of r implies 
that if l^l < r and if (^(•) G H"-{x) then <j){t) G -6(0,1) for ah t G [0, oo). This implies that 
r]{\(p{t)\) = for all t, thus for such x, V'^{x) = 0. This proves part 1. Now we show the local 
Lipschitz property in 2. Let x G JR" be such that |x| < R. Without loss of generality we can 
assume that |x| > | for else local Lipschitz property holds trivially. From Proposition 14.31^ 1) 
it follows that we can choose Tq < oo such that for any cf) G H°'{y)] \y\ < i? + 1 we have that 
(j){t) = for all t > Tq. For an absolutely continuous trajectory (j) : [0, oo) ^ iR", define 

T*{ct)) = inf{t G (0,oo) : (/)(t) G B(0,r/2)}. 
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Now let (f) G H°-{x) and x G i?(0, i?) be such that 

/•r*(0) 

V%x)< / r^mt)\)dt + e. 
Jo 

Note that we could replace oo by T*{(j)) in the upper limit of the integral on the right, because 
of Proposition 012') ■ Let y E iR" be such that, \y\< R+ 1. 

It will be shown in Lemma 14.51 that there exist measurable functions qi : [0, oo) [0,1]; 
i = 0, . . . , N and (3 : [0, oo) Ci such that 0(-) solves 

N 

Ht) = T.'li(tKiPit),Ht)), a.e.tG[0,oo) 

i=0 

(p{0) = X. 

Now let be an absolutely continuous function such that for a.e. t G [0, oo) 

N 

1=0 

V^(O) = y. 

Existence of such a tp(-) will be proved in Lemma 14.41 Since ip G H°'{y), we have that T*{'ip) < 
Tq. We now claim that if y is sufficiently close to x then both (j){T*[(j)) A t*{^)) and ■0(t*((/') A 
T*(';/')) are in i?(0,r). To see this note that as a consequence of 1)4. 20() and ()4.21|1 . for t G 

[O,r*(0) Ar*(^)], 

m) - m\ <\y-x\+C* f \(p{s) - ^{s)\ds, 

Jo 

where C* = C(a, |, i? + 1 + TqD). By an application of Gronwall's inequality we see now that 
\i\y-x\<^ exp(-C*ro) = C then 

m) - m\ < exp(C*ro)|y - x| < ^ (4.22) 

for ah t G [O,r*(0) Ar*(V')]. 

This means that for such y both and ^{■) are in B{0,r) at time T*{(f)) Ar*('0). Hence- 
forth we will only consider such y (i.e. |y — < C). Note next that 

F«(x) - y'^(y) < r ^'^^"'^ ^'^\??(|c/>(t)|) - r/(|V(t)|)^it + e. 
Jo 

< r]iipToe'^*'^°\y - x\ + e, 

where ijnp is the Lipschitz constant for t/(| • |). Sending e — > and using the symmetry of the 
above calculation we have that 

IV'ix) - V^y)\ < mipe'^*'^°\y - x\ (4.23) 
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for all |x| < R and ly — x| < C. Since i? > is arbitrary, this proves part 2. 

To prove part 3, we will show that at all points x at which is differentiable and |x| > r 

max DVix) ■ u < -r?(|x|). (4.24) 

Fix R G [2,oo). Now let r < |x| < R - 1 and u £ K"-{x). Then there exist G [0,1]; 
i = . . . ,N satisfying Ylf=o Qi = ^ ^-nd P £ Ci such that u = J2iLo Qi^fiP, x). Define for y such 
that \x-y\ < §, u{y) = J2iLo Qi^f , y) ■ In view of KTHii there exists C = C{a,r/2,R + 1) 
such that 

\u{x) — u{y)\ < C\x — y\. 

Now for a given y such that |y| > | and |x — y| < r/2. define (pyi') to be the absolutely 
continuous function which satisfies 

<Py{t) G K'^iMt)), cPyiO) = y 

for t £ [0, oo) and is e-optimal, i.e. 

^"(y)< / vi\M^)\)ds + e. 
Jo 

Let 4>{-) be an absolutely continuous function such that </>(•) solves: 

<i>{t) = u{(^{t)); (/>(0)=x, 

t G [0,oo). The existence of such a is again assured from Lemma 14.41 Now let tq > be 
such that for all t G [0, tq], \(t>{t) — x\ < ^ and to\u\ < ^. Now set y = (/•(tq). Note that since 
C < r, we have that |x — y| < | and \y\ > r/2. Consider the following modification of the 
trajectory (!){■). 

4>{t) = (l){t)- t G [0,ro] 
Kt) = (Pyit-To); t>To 

Note that by construction </)(•) solves the differential inclusion: 

4){t) G K''{^{t)); yt G [0,oo). 
Now an argument, exactly as on pages 694-695 of 'H" shows that 

Vix + T0U) -V°-(x) , 1 /,7, ^,^ /, ,^^ , 



To To Jo 

Taking limit as tq — > we have part 3 
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Now we consider part 4. Let (p £ H"'{x) and let f = inf{t : (j){t) £ 5(0, 2)}. Then we have 
that 

2 > 10(0)1 - I f <j){s)ds\ 
> \x\-fD. 







Thus f > ^—jy—- Since ^(|x|) = 1 for \x\ > 2 we have that 



V-{x) > I r/(|0(s)|)d. > (4.25) 



This proves part 4. 



Finally, we consider part 5. We will show that there exists a S (0, oo) such that for all 
x G iR" for which V'^{x) is differentiable, we have that 

W^(x) — > -(1-^). 

\x\ a \x\ 

This will clearly yield part 5. Without loss of generality assume that |x| > | since otherwise 
the inequality holds trivially. In order to show the inequality it suffices to show, in view of 
part 4, that 

DV^ix) ■ ^ > (4.26) 

Now the proof of (|4.2(i|) is identical to the proof of Proposition 3.7 of 5.^ on observing that if 
(j) G H"-{x) then for c G (0, oo), the trajectory O^'i-), defined as O'^it) = (1 + c)<f>{j^), t > 0, is 
in H°-{{\ + c)x). We omit the details. ■ 

The proof of Theorem 14.21 used in addition to Proposition 14.31 the following two lemmas. 
The first lemma is a classical existence and uniqueness result, a sketch of whose proof is 
provided in the appendix, while the second is a result on measurable selections. 



Lemma 4.4 Let qq be as in Proposition^^ and a G (0, ao) be fixed. Let qi{-); i = 0, . . . , N be 
measurable functions from [0, oo) [0, 1] such that J2iLo Qii^) — ^ Z*^*" '^^^ * ^ ^) '^'^'^ /^(O 
be a measurable function from [0,oo) Ci. Let y G iR" be arbitrary. Then there exists an 
absolutely continuous function </»(•) on [0, oo) such that 

N 

Ht) = E9*(*)<(/5(*)'0(*)); a.e. tG[0,oo) 

m = y- (4.27) 
Furthermore if ip{-) is another absolutely continuous function solving i4.2'/\ ), then cp = ip. 
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Lemma 4.5 Let a > be fixed and (j){t) he an absolutely continuous function on [0, T] such 
that 

E /^"((/>(t)), a.e. tE[0,r]. 

Then there exist measurable functions qi : [0, T] — > [0,1]; i = 0, . . . , N and (3 : [0, T] Ci such 
that J2i Qii't) = 1 md 

N 

<j){t) = Y,q,{t)vtm)Ait)), a.e.ie[0,r]. (4.28) 

i=0 



Proof: Let B be the subset of JR" x JR" \ {0} defined as 

N N 
{{u,x)elW'xlW'\{0}:u = Y,qivfiP,xy, qi € [0,l];i = 0, . . . , N, P e C,, 5^% = !}. 

i=0 i=0 

Let be the Borel a-field on [0, 1]^+^ x Ci. Define F : B ^ as 

N N 
F{u, x)={{q,P):qe [0, /3 G Ci; J] q^vfiP, x) = u; Y.^i = 1}. 

i=0 i=0 

Note that the map (x, /3) — > vf{f3, x) is continuous on iR" \ {0} x Ci for all i = 0, 1, . . . , A^. This 
implies that if we have a sequence {qk, Pk, Uk^^k) — > (q, u, x) G [0, 1]^+^ x Ci x iR" x iR"'\ {0} 
and [qkiPk) G Fiuk,Xk) for all k then (g, /3) G F{u,x). Thus in view of Corollary 10.3, 
Appendix of [S] there exists a measurable selection for F, i.e. there exists a measurable map: 

f:B^[0,lf+'xCi 

such that f{u,x) G F{u,x) for all G -B. Choose an arbitrary element {q,P) G [0, 1]^+^ x 

Ci such that J2fLQ qi = 1 and extend / to B = (0, 0) by setting /(0, 0) = {q, Now write 
/(•) as {{fi{-)}iLo, /*(•))) we denote the first A'' + 1 coordinates of the vector function / by 
fi] i = 0, . . . , N, and we denote the + 2'th coordinate by Define 

Qiit) = fSit), Ht)); i = 0,l,...,N; a.e. t G [0, cxd) 

P{t) = f,{^{t),^{t));a.e.te [0,cx)). 
Clearly q{-) and /?(•) are measurable functions and by construction (|4.28|) holds. ■ 

Now we turn to the proof of Proposition 14. HI The key idea is to relate the solutions of the 
differential inclusion (j)(t) G K'^((f>(t)); (/>(0) = x, for small enough value of o, with the solutions 
of the SP for trajectories with velocity in Ci. The following two results are central in that 
respect. Define for x G iR" 

K{x) = {v £ iR" : there exists a sequence {ak,Xk,Vk)k>i C (0, 1] x iR" x iR" 
s.t. ak ^0; Xfc — > X] Vk — > v; and Vk G K°''"{xk)}- 
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We will denote the closure of the convex hull of K(x) by K{x). The first result shows that as 
a approaches the solutions of the differential inclusion converge to a trajectory which also 
solves a differential inclusion given in terms of K. The proof is quite similar to the proof of 
Proposition 3.3 of 0. We provide a sketch in the appendix. 

Lemma 4.6 Consider the sequence {xk, ak, 4'k{'))k>i C iR" x (0,1] x C([0, oo); iR") such that 
Xk x; ak 0, and (pk{') ~^ (uniformly on compacts). Suppose further that each (pj^ is 
absolutely continuous and solves the differential inclusion: 

4>k{t) G K'"^{(t)k{t)); a.e. t G [0,oo); <^fc(0) = x^- 

Then 0(-) is Lipschitz continuous (and thus absolutely continuous) and it solves the differential 
inclusion: 

(j}{t) E 'K{(j){t)); a.e. t £ [0, oo); 0(0) = x. 

The proposition below provides the connection between the solutions of the differential inclu- 
sion <j)(t) G K{4>(t)); 0(0) = x and certain solutions to the SP. Define 

6o= inf d^-m. (4.29) 

(A,i):AeA, ieX 

By Condition EH Sq > 0. 

Proposition 4.7 Let <j) : [0, cxd) IR^ be an absolutely continuous function which solves the 
differential inclusion: 

<j){t) e 'K{(t){t)), a.e. t £ [0, oo). 

Then there exists a r G [0, |0(O)|/(5o), a strictly increasing, onto function a : [0, oo) [0, oo) 
and a measurable function (3 : [0, oo) — > Ci such that 

V'(t) = 0(t + a{t)) = T (^<P{t) + ^ 'P{u)du^ {t), t E (0, oo). 



Before presenting the proof of this proposition, we show how the proof of Proposition 14.31 
follows. For an absolutely continuous trajectory 6 : [0,oo) i-^ iR", define 

T{e) = mi{t G (0, oo) : 9{t) = 0}. (4.30) 

Proof of Proposition 14.31 First we show that there exist aQ,T G (0, oo) such that for all 
a £ (0, ao) and absolutely continuous 0(-) on [0,oo) satisfying 

0(t)Ei^"(0); 10(0)1 < 1; a.e. t E [0,oo), 
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we have that 



inf U(t)\ < 1/2. (4.31) 



We argue by contradiction. Suppose that there exists a sequences {Tk}k>i increasing to oo, 
{ak}k>i decreasing to and {(j)k{-)}k>i such that for ah k, (j)k{-) is absolutely continuous, for 
a.e. t £ [0, oo), 

and info<j<rj. \4'k{t)\ > 1/2. As in Proposition 3.3(i) of [Sj we have that {(j)k]k > 1} is 
precompact in C([0, oo); iR"). Assume without loss of generality that 4>k(,-) converges to </)(■) 
uniformly on compacts. Clearly |(/'(0)| < 1 and 



> 1/2, for all t G [0,oo). (4.32) 

From Lemma [4.6l we have that (/>(•) is absolutely continuous and solves the differential inclusion: 

(l){t) eK{(t){t)) a.e. t e [0,oo). 

Therefore from Proposition 14.71 we have that there exists r G [0,5o^^]) a strictly increasing, 
onto function a : [0, oo) — > [0, oo) and a measurable function (5 : [0, oo) — > Ci such that for all 
t > 



(r + a{t)) = T (^(^(r) + ^ (3{u)dv}j (t). 



Now applying Proposition 14. II we have that lim^^oo (pi"^ + ck(0) = 0- This is a contradiction to 
(|0^ . Hence (|I3T|) is proven. 

Now let ijj be an absolutely continuous function on [0, oo) satisfying 

Tpit) e K'^ii^y, |V(0)|<2^ a.e. t G [0,oo). 

Assume without loss of generality that ^ and define cl){t) = 2~^ip{2^t). Since K"'{x) = 
K°'{ax) for all a > we have that 

0(t) G -fC" ((/>); |</>(0)| < 1; a.e. t E [0, oo). 

Thus 

inf m)\ = inf 2^|</)(t2-^)| 

0<t<T2'= 0<t<T2'= 

= 2'^ inf U(t)\ 
0<t<T ' 

< 2V2. 

Now let g{-) be as in the proposition. Then letting k = m, (m — 1), . . . , 0, —1, ... we have 
that info<j<2'"+iT 15(01 = Since -fC"(0) = 0, we have part 1. 
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Now we consider part 2. Let (ao,T) be as above. We will show that there exists < clq 
and r £ (0, 1) such that the statement 2 in the proposition holds. We will once more argue by 
contradiction. Suppose that there exist sequences (a^, r^, (/)*^(-)) such that 

(/.'^•(O e K''>'{^''{t)y, a.e. t G [0,oo), 

[^''(O)! < rk, rfc ^ 0, Ofc ^ and 

\(l)''{tk)\ > cfor some tk G [0,oo). (4.33) 

Assume without loss of generality that < 1 and < ao for all > 1. From 1 we know that 
t{4>^) < 2r for all k > 1. Also note that from the uniform Lipschitz property of and 
noting that (/>'^(0) — > as A; — > cc we have that T* = inffcr((/>'^) > 0, since otherwise (p^{tk) 
converges to along some subsequence, which contradicts (j4.33j) . So now assume without loss 
of generality that T{(f)^) T*, t* and — > 0(-) uniformly on [0,T*] as A; ^ cxd. From 

Lemma 14.61 we have that is absolutely continuous on [0, T*] and solves the differential 
inclusion (/>(t) G K{(j)(t)), a.e. t £ [0,T*], (f)(0) = 0. From Proposition 14. 71 and Proposition 14. II 
we then have that cl){t) = for all t G [0, T*]. But on the other hand, since (p^{tk) > c, we have 
that (j){t*) > c, which is a contradiction. This proves part 2 and hence the proposition. ■ 

We now prove Proposition 14.71 We will need the following three lemmas. The first lemma 
characterizes the set K(x) and its proof is similar to the proof of Proposition 3.2 of |8| (and 
is thus omitted). The second lemma says that a solution of the differential inclusion (/>(t) G 
K{(j){t)), enters G after some finite time, and then stays within G. The third lemma gives a 
representation for a solution to the above differential inclusion. 

Lemma 4.8 For x G iR" \ {0}. 

'K{x) C conv{Ci U {dj : i G In(x)}, if x G dG 
C Ci, ifx G G° 

C conv{d^ : A D {i : x • nj < 0}} i/x G G". 

(4.34) 

Lemma 4.9 Let (f) : [0, oo) be an absolutely continuous function which solves the dif- 

ferential inclusion: 

<j){t) G K{(j){t)), a.e. t G [0,oo). 

Then the following hold. 



1. Let t G [0, cxd) be so that (/){■) is differentiable at t and (f)[t) ^ G, then 

>So. 



lit 



min (bit) ■ e,- 
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2. If (piO) G G then (t){t) G G for all t G [0, cxd) 

m 

So 

Proof: Parts 2 and 3 follow immediately once 1 is proven. We now present the proof of (1) 



3. If(p{0) G then there exists r < such that (p{t) G G for all t > r. 



Fix y G G^. Define Xi{y) = {i : y-rii < 0}. Note that whenever A D Ai(y), we have from (|4.2' 
that • Ui > 6o, Vi G Ai(y). This yields the implication: 

V G conv{d^ : A D Ai(?/)} =^ f • > (5o, Vi G Ai(y). (4.35) 

Define 

A(y) = {i e Xi{y) : y ■ Ui = mm{y • rn}}. 

Now let t G [0, cxd) be such that 0(-) is differentiable at t and G C^. Then by continuity of 
we can choose e > such that for all < /i < e: 

min (j){t + h) ■ Ui = min i;^>(t + h) ■ ni. 
je{i,...,Af} j6A(</.{t)) 

and 

Ai(0(t + /i)) D Ai(</.(t)). (4.36) 

Next observe that 



It 



min (iff) • n,- 



= lim — ( min Sit + h) ■ n-, — min Sit) ■ Uj | 
/i l^ie{i,...,JV} ^ ^ ie{i,...,7V} ^ ^ 7 

= lim — min {(^{t + h) ■ Ui — (j){t) ■ rij) 
1 f'^ ■ 

= lim min — / (j){t + s) ■ riids 
h~>o ie\{4){t)) h Jo 

> So, 

where the last step follows from 1)4. 35|) on observing that in view of Lemma 14.81 and ()4.36|) for 
a.e. s G [0, h] 

^{t + s) G K{(p{t + s)) 

C conv{d^ : A D Xi{<p{t + s))} 

C conv{d^ : A D Ai((/)(t))}. 

This proves the lemma. I 

The following lemma once more uses a result on measurable selections. The proof is quite 
similar to Lemma 14.51 and a sketch is given in the appendix. 
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Lemma 4.10 Let (f) : [0, cxd) iR" be an absolutely continuous function such that (j){0) G G 
and (j) solves the differential inclusion: 

(j){t) £ 'K{4){t)); a.e. t. 

Then there exist measurable functions qi : [0, cxd) — > [0, 1]; i = 0, 1, . . . , N , satisfying the equality 
J^fLoQii^) = Ij (^''T'd measurable map /5o : [0, oo) Ci such that for a.e. t G [0,oo) 

Ht)= J2 qi{t)di+qoit)Po{t). 

jeln(0(t)) 



Proof of Proposition I4T71 Prom Lemma EH we know that 4'{t) G G for a.e. t > t. From 
Lemma I4.1UI it follows that there exist measurable functions qi : [0, oo) — > [0, 1]; i = 0, 1, . . . , A'' 
and (3q : [0, oo) — > Ci such that for a.e. t > t 

<j>{t)= J2 qi{t)di+qo{t)(3o{t). 

Let {n^}x^\ be as in Remark l'2.2l Define 5=,, = inix^A-iizxn^ • di. Also let 7 = sup^g^i We 
now claim that for a.e. t G [r, 00) 

qo{t) > (4.37) 

Let A G A \ {0} be arbitrary. Define 

= {x G iR" : In(2;) D A}. 

Since (/){■) is absolutely continuous and F'^ is a linear subspace of iR" we have that for a.e. t 
whenever (j){t) G we have that (p{t) G -F'^. Thus for a.e. t, I|^(^)g^A|0(t) • n'^ = 0. Now 
observe that for a.e t > r such that 0(t) G F^: 

= n^.0(t) 

= • ((A(t) - go(i)/3o(i)) + ■ qo{t)Po{t) 

= n^-J2qi{t)di + qo{t)n^-Po{t) 

iex 

> ^*^qi{t) -iqo{t)- 

This proves 1)4. 37(1 for a.e. t > t such that (f){t) G F^. Also the claim holds trivially if (j){t) G G*^ 
since then qo{t) = 1. Now letting A run over all the subsets of A we have the claim. Next 
define the strictly increasing function o : [0, 00) — > [0, 00) as 



o-it) = / QoiT + s)ds; tG[0, 00). 
Jo 
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Also set a{t) = a ^{t). Finally we show that ip{-) = (j){T + a(-)) solves the SP for 

x{.) =x{0) + f P{s)ds, 





where x(0) = (/>(t) and f3{t) = Pq{t + a{t)), t G [0,oo). To see this we only need to observe 
that for a.e. t >0 

"^^^ go(r + a(t)) 

^ / /NX QiiT + , 



This proves the lemma. 



5 Appendix 

Proof of Lemma 14. 4t The proof is via Picard iteration method. Define (p^'^^-) = y on [0, T]. 
For k>l, define for t G [0, T] 

Note that the boundedness of qi{-) and vf{f3{-),-) assures that (/)(^)(-) is an equicontinuous 
family (in fact uniformly Lipschitz continuous) which is pointwise bounded on [0, T] for all 
T < oo. Thus there exists a subsequential (uniform) limit Clearly (/>(•) is Lipschitz 

continuous and thus absolutely continuous. Note that the map {x,l3) vf{(3,x) is continuous 
on iR" \ {0} X Ci. Therefore we have that as A; ^ oo, vf{P{t), cl)(''-^\t)) vf{P{t),(l){t)) for 
all t £ [0,T((j))), where T{<j)) is as defined in (|4.H()j) . Now a straightforward application of the 
dominated convergence theorem shows that (p{-) solves ()4.27() on [0, r((/))) and hence, since 
vf {■,()) = 0, on [0,oo). Now let </)(•) and V'(-) be two solutions to (|4.27|) . We will show that 

0(t) = my t e [0, r(0) A r(^)). (5.38) 

Fix e > 0. Then there exists m > such that min(|(/)(t)|, |V'(i)l) > "m on [0,T((p) A r(V') — e). 
Also let M = supo<t<T-((/,) ™ax{|(?!)(t)|, |'i/'(i)|}. Then from (|4.2fl|) we have that 

\m - m\ < C{a, m, M) f |0(s) - m)\ds, 

Jo 

for all t £ [0,T{(j)) A T{ip) — e). An application of Gronwall's inequality shows that (p and ^/^ 
are equal on [0,r((/)) A T{ip) — e). Since e > is arbitrary, we have (|5.38|) . This also implies 
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that T{(j)) = T[ij)) and since both trajectories stay at once they hit 0, we have the desired 
uniqueness on [0, cxd). ■ 

Proof of Lemma 14. 6L The Lipschitz continuity of (j) fohows immediately on observing that 
for < s < i < oo and k>l \(t)k{t) - (t>k{s)\ < D\t - s\. We will show that for all T £ [0,oo), 
4>{t) G a.e. t G [0, T]. Fix T G [0,oo). Define a sequence of probability measures on 

no = lR'' X M"" X [0,r] as follows. For / G CbiFC xWx [0,r]) define 



Since 



/ f{x,y,t)dfik{x,y,t) = ^[ f{(l)k{s),4'k{s),s)ds. 



sup ItAfcC*)! < sup + DT = C < oo (5.39) 

k>l,se[0,T] k>l 



and |i?5>A;(s)| < D a.e. s, we have that {fj,k}k>i is a tight family of probability measures. Without 
loss of generality assume that Hk converges weakly to //. The sequence {fJ-k} gives the following 
useful representation for {4>k}- 

4>k{t)=Xk+[ [ ydi2k{x,y,s). 



JM"xlR" 



Taking limits in the above equality we have 



(t>{t) = x+ / / ydfi{x,y,s). (5.40) 

Jo JR^xM" 

Next note that the marginal distribution of Hk in the time variable is the normalized Lebesgue 
measure on [0, T] for every k and thus fi also has the same marginal distribution. Therefore 
there exists jl{s, •), a regular conditional probability distribution, such that for / G Ci,{]R^ x 
iR*^ X [o,r]) 

[ f{x,y,t)dfi{x,y,t) = ^f ([ f{x,y,t)il{t,dx,dy)]dt. (5.41) 

JQo J Jo \JM"xM" J 

Thus from (|5.4U|) we have that 

(/>(t)=x + / ( / yjl{s,dx,dy)] ds. 

Jo \JJR"xiR" / 

This shows that for a.e. t G [0, T], 

kt) = I yHt,dx,dy). (5.42) 

J]R"xIR" 

Using the upper-semi continuity of the set K{x), it follows as in (see pages 687-689) that 
the support of fl{t,dx,dy) is contained in {(j){t)} x K{(p{t)). Thus we have from (|5.42j) . on 
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noting that K{x) C K(x) and K{x) is a closed convex set, that (j){t) G K[(j){t)). This proves 
the lemma. I 

Proof of Lemma I4.10L For A E A define 

B^ = {u(^M' ■.u = Y,(lidi + qo(i: E9» + 9o = l; >0; /3 G Ci}. 

Denote the class of Borel subsets of [0, x Ci by i^l'^L Define the set- valued map F"^ : 

ijl^l as follows. For u £ 

F\u) = {{q,p) ■.q={qi),exu{0} G [0,1^+^; p e Ci; ^ (/i + 'Zo = 1; and ^ + ^o/? = ^^}. 

ieA iex 

We would like to show that there exists a measurable selection for F^, i.e. there exists a 
measurable map: 

-.B^ ^ [0,1]I^I+^ X Ci 

such that for all u G B'^, f'^{u) G F^{u). In order to show this it will suffice to show (in 
view of Corollary 10.3, Appendix, ,9.) that if {qk,f3k) G F^(ufc) and Uk ^ u then the sequence 
{qk, f3k)k>i has a limit point in F^{u). But this is an immediate consequence of the compactness 
of [0, X Ci. Now fix such a measurable selection for every A G A. Set 

/^(•) = iifi'i-))ieXU{0}^ fvel)^ 

where : B^ ^ [0, 1] for i G A U {0} and /^^ : B^ ^ Ci are the coordinate maps defined 
in the obvious way. Let (/)(•) be as in the statement of the theorem. Define for all t for which 
In((/)(t)) = A and 4){t) G ^((/.(t)), 

Qoit) = f^m)); Qiit) = ftm)); i G A; q^{t) =0; i ^ A and /?o(t) = fiMt)) ■ 

Thus letting A vary over all the subsets of A we have a.e. defined measurable functions 
(gi(-))j=o,i,...,Ar, as required in the statement of the lemma. ■ 
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